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BACKGROUND OF THE INVENTION 

1, Field of the Invention 

5 [0001] This invention relates to host system configuration of devices attached to a 
fabric in a storage network. 

2. Description of the Related Art 

10 [0002] Storage area networks, also referred to as SANs, are dedicated networks that 
connect one or more systems to storage devices and subsystems. Today, fibre channel is 
one of the leading technologies for SANs. In general, fibre channel encompasses three 
networking topologies: point-to-point, loop, and fabric. In a point-to-point topology, a 
fibre channel host adapter in a system is typically connected to a single fibre channel 

15 storage subsystem. In a fibre channel loop network, also called an arbitrated loop, the 
loop is constructed by connecting nodes together in a single logical ring. Loops can be 
constructed by connecting nodes through a fibre channel hub in a star-wired topology or 
by connecting them together in a connected physical loop from node to node. In a fibre 
channel fabric topology, the storage networks are constructed with network switches. A 

20 fabric can be composed of a single switch or multiple switches. Ports on fabric networks 
connect nodes to switches on low-latency, point-to-point connections. 

[0003] The nodes connected in the loop and fabric topologies refer to "network 
nodes" and can be any entity that is able to send or receive transmissions in a fibre 

25 channel network. For example, a node can be a computer system, a storage 
device/subsystem, a storage router/bridge that connects SCSI equipment, a printer, a 
scanner, or any other equipment, such as data capture equipment. The ANSI X3.272- 
1996 specification entitled "FC-AL, Fibre Channel Arbitrated Loop" and the ANSI 
X3.T11 Project 1133-D specification entitled "FC-AL-2, Fibre Channel Arbitrated Loop" 

30 describe examples of fibre channel loop topologies in further detail. The ANSI X3.T11 
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Project 959-D specification entitled "FC-SW Fibre Channel Switch Fabric" describes an 
example of a fibre channel fabric in further detail. Note that the most recent versions of 
these and related specifications may be obtained from the Tl 1 technical committee of the 
National Committee for Information Technology Standards (NCITS), 

5 

[0004] For point-to-point topologies and loop topologies, device drivers executing on 
a host computer perform device discovery at host boot-up to determine locally connected 
devices. The discovered devices are configured to be accessible to applications running 
on the host by creating a node for each device within the host. These types of nodes are 

10 referred to as operating system device nodes. Each node functions as an internal (to the 
host) representation of an attached device and provides a communication path to the 
device. Since the number of devices attached to a host in point-to-point and loop 
topologies are limited, the discovery process may be completed within an acceptable time 
frame. Due to the number of devices capable of being attached to a fabric, discovering all 

15 fabric devices available to the host at host boot-up may not be feasible. Additionally, a 
host computer may desire to maintain its fabric device configuration across reboots and 
adjust for changes in the fabric. 
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SUMMARY OF THE INVENTION 



[0005] Methods, systems, and programs for discovering devices in a storage network 
are described for various embodiments of the present invention. A fabric configuration 
5 interface may provide for storing multiple configuration repositories identifying different 
configurations of fabric devices for a host system coupled to a fabric. Each configuration 
repository identifies one or more fabric devices. The fabric configuration interface may 
receive a request to online fabric devices according to a specified one of the configuration 
repositories. In response to such a request, the configuration repository may access the 

10 specified configuration repository and request a configuration operation to configure, for 
the host system, some or all of the fabric devices identified in the specified configuration 
repository according. The fabric configuration interface may provide for requesting that 
fabric devices listed in a specified configuration repository be onlined or offlined. The 
fabric configuration interface may also provide for deleting entries from a specified 

1 5 configuration repository. 

[0006] In some embodiments, a host system may include one or more adapter ports 
for connecting to a fabric. The host system may also include a fabric driver configured to 
interface the host system to the fabric and a fabric configuration interface configured to 

20 manage a plurality of different configuration repositories. Each configuration repository 
may indicate a specific fabric device configuration for the host system. The fabric 
configuration interface is configured to provide a standard interface for creating the 
different configuration repositories. The fabric configuration interface is also configured 
to provide a standard interface for requesting a configuration operation according to 

25 configuration information stored in a specified configuration repository. The fabric 
configuration interface may also provide an interface for modifying and/or verifying 
information in the configuration repositories. 
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BRIEF DESCRIPTION OF THE DRAWINGS 



[0007] Figure 1 illustrates a host computer attached to a fabric and one or more local 
devices; 

5 

[0008] Figure 2 illustrates an example of a storage area network (SAN) suitable for 
implementing various embodiments of the present invention; 

[0009] Figure 3 is a flowchart illustrating an on-demand node creation process 
10 according to an embodiment of the present invention; 

[0010] Figure 4 illustrates an example of a storage network suitable for implementing 
various embodiments of the present invention; 

15 [0011] Figure 5 is an illustration of a host computer coupled to a fabric according to 
one embodiment of the present invention; 

[0012] Figure 6 is a flowchart illustrating a device discovery process, according to 
one embodiment of the present invention; 

20 

[0013] Figure 7 is a flowchart illustrating an on-demand device node creation 
process, according to one embodiment of the present invention; 

[0014] Figure 8 is an illustration of a system coupled to a fabric according to an 
25 embodiment of the present invention; 

[0015] Figure 9 is a flowchart of an on-demand node creation process for fibre 
channel fabrics according to an embodiment of the present invention; 

30 [0016] Figure 10 is a flow chart illustrating a method for onlining selected fabric 
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devices on-demand from a list of fabric devices, according to one embodiment of the 
present invention; 

[0017] Figure 1 1 is a flowchart illustrating a mechanism for dynamically updating a 
5 persistent repository to reflect a changes a in the fabric, according to one embodiment of 
the present invention; 

[0018] Figure 12 is a flowchart illustrating a mechanism to allow a host's fabric 
device configuration to persist across reboots and shutdowns, according to one 
10 embodiment of the present invention; 

[0019] Figure 13 is an illustration of a system including a standard fabric 
configuration interface for creating and maintaining various different fabric device 
configurations on a host system, according to one embodiment of the present invention; 

15 

[0020] Figure 13A is an illustration of modules which may be included in a fabric 
driver according to one embodiment of the present invention; 

[0021] Figure 14 is an illustration of a system including a standard fabric 
20 configuration interface for creating and maintaining various different fabric device 
configurations, including a default configuration, on a host system, according to one 
embodiment of the present invention; 

[0022] Figure 15 a flowchart illustrating a method according to one embodiment of 
25 the present invention in which an application may use a fabric configuration interface to 
modify or create a specific fabric device configuration; and 

[0023] Figure 16 a flowchart illustrating a method according to an embodiment of the 
present invention in which an application may use a fabric configuration interface to 
30 modify or create a specific fabric device configuration. 
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[0024] While the invention is described herein by way of example for several 
embodiments and illustrative drawings, those skilled in the art will recognize that the 
invention is not limited to the embodiments or drawings described. It should be 
understood, that the drawings and detailed description thereto are not intended to limit the 
invention to the particular form disclosed, but on the contrary, the intention is to cover all 
modifications, equivalents and alternatives falling within the spirit and scope of the 
present invention as defined by the appended claims. 
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DETAILED DESCRIPTION OF EMBODIMENTS OF THE INVENTION 



[0025] Figure 1 illustrates a host system 108 attached to a fabric 104, which is 
suitable for implementing various embodiments of the present invention. The host 
5 system 108 may include at least one central processing unit (CPU) or processor 102. The 
CPU 102 may be coupled to a memory 112. The memory 1 12 is representative of various 
types of possible memory media (also referred to as "computer readable media"): for 
example, hard disk storage, floppy disk storage, removable disk storage, flash memory or 
random access memory (RAM). The terms "memory" and "memory medium" may 

10 include an installation medium, e.g., a CD-ROM or floppy disk, a computer system memory 
such as DRAM, SRAM, EDO RAM, SDRAM, DDR SDRAM, Rambus RAM, etc., or a 
non-volatile memory such as a magnetic media, e.g., a hard drive, or optical storage. The 
memory medium may include other types of memory as well, or combinations thereof. In 
addition, the memory medium may be located in a first computer in which the programs are 

15 executed, or may be located in a second different computer which connects to the first 
computer over a network. In the latter instance, the second computer provides the program 
instructions to the first computer for execution. 

[0026] As shown in Figure 1 the memory 1 12 permits two-way access: it is readable 
20 and writable. The memory 1 12 may store instructions and/or data which implement all or 
part of the system and method described in detail herein, and the memory 112 may be 
utilized to install the instructions and/or data. In various embodiments, the host system 
108 may take various forms, including a personal computer system, desktop computer, 
laptop computer, palmtop computer, mainframe computer system, workstation, network 
25 appliance, network computer, Internet appliance, personal digital assistant (PDA), 
embedded device, smart phone, television system, or other suitable device. In general, the 
term "computer system" may be broadly defined to encompass any device having a 
processor which executes instructions from a memory medium. 

30 [0027] The host system 108 may be coupled to a fabric 104, which may provide 
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access to a plurality of fabric attached devices, such as persistent storage devices or other 
computer peripheral devices. The CPU 102 may acquire instructions and/or data through 
an input/output interface 110. Through the input/output interface 1 10, the CPU 102 may 
also be coupled to one or more local devices 103, such as local input/output devices 
5 (video monitors or other displays, track balls, mice, keyboards, etc.) local storage devices 
(hard drives, optical storage devices, etc.), local printers, plotters, scanners, and any other 
type of local I/O devices for use with a host system 108. Some local devices may be 
referred to as direct attach devices. Input/output interface 110 may include host adapters 
111a and 111b for coupling to local devices 103 and fabric 104 respectively. Host 
10 adapters 111a and 111b may be fibre channel adapters (FCAs). In one embodiment, one 
or more of the local devices may be included in the host system 108, such as in expansion 
slots of the host system 108. In one embodiment, one or more of the local devices may be 
externally connected to the host system 108. 

15 [0028] The host system 108 may be operable to execute one or more computer 
programs. The computer programs may comprise operating system or other system 
software, application software, utility software, Java™ applets, and/or any other sequence 
of instructions. Typically, an operating system (OS) performs basic tasks such as 
recognizing input from the keyboard, sending output to the display screen, keeping track 

20 of files and directories on the disk, and controlling peripheral devices such as disk drives 
and printers. Application software runs on top of the operating system and provides 
additional functionality. In one embodiment, the OS may be based on Sun 
Microsystems ? s Solaris™ operating system. The computer programs may be stored in a 
memory medium or storage medium such as the memory 1 12, or they may be provided to 

25 the CPU 102 through the fabric 104 or I/O interface 1 10. 

[0029] Figure 2 illustrates an example of a SAN coupled to host computers 108 A and 
108B. The SAN shown in Figure 2 includes a fabric interconnect 105 coupled to hard 
drives 21 OA, 21 0B, and 2 10C, tape drive 2 11, and optical drive 2 12. Hard drives 21 OA, 
30 210B, and 210C, tape drive 211, and optical drive 212 are also referred to as fabric 
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devices. It should be noted that the number and types of hosts and devices shown in 
Figure 2 are for illustration purposes only, and the actual number and types of hosts 
and/or devices in a SAN may vary. Fabric interconnect 105 may include one or more 
switches which are connected to the network nodes with an optical, copper cable, or other 
5 type of cable or interconnect medium, 

[0030] Figure 4 illustrates an example of a storage network which includes a direct 
attached private loop 306 and a fabric 410. It should be noted that storage networks may 
be configured in a variety of different ways and many include one or more direct attach 
10 devices, SANs, and/or network attach (NAS) devices. Furthermore, it should be noted 
that fabrics and/or SANs are not limited to fibre channel technologies and architectures 
but may include various types of technologies. For example, some or all of a SAN may 
be based on the InfiniBand™ Architecture or iSCSI (SCSI over IP). 

15 [0031] Host adapter 304 couples host system 402a to private loop 306 and adapters 
404a and 404b couples host system 402b to fabric 410. Note that host adapters 304, 404a 
and 404b may be separate host bus adapter cards, for example. In other embodiments, 
host adapters 304, 404a and 404b may each refer to a separate host adapter port. Coupled 
to private loop 306 are one or more direct attach devices 308. Direct attach device(s) 308 

20 are considered local to host system 402a. 

[0032] The host system 402b is coupled to fabric 410 via host adapter 404c. Fabric 
410 includes fibre channel switches 412 which are coupled to multiple fabric devices 408. 
Each fibre channel switch may connect to various fibre channel topologies such as point- 
25 to-point fibre channel connections or fibre channel loops. Each switch may also connect 
to one or more other fibre channel switches. The fabric devices 408 may be various 
storage devices such as hard disk drives, optical drives, tape drives, etc. In some 
embodiments fabric devices 408 may be any type of I/O device such as storage devices, 
printers, scanners, etc. as are used in conjunction with computer systems. 

30 
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[0033] Due to the large number of devices which may be present in fabric 410, the 
time required for a host system 402 to discover and online all of the devices available 
through fabric 410 may be impractical. Furthermore, it may be unlikely that host system 
402 actually needs to communicate with all of the various fabric devices 408. The term 
5 "online" may be used herein to refer to creating a node to provide a communication 
mechanism or path to a device. 

[0034] Figure 5 illustrates a host system 508 coupled to a fabric 510 according to one 
embodiment of the present invention. The fabric 510 may be implemented with one or 

10 more switches coupled to one or more storage devices or subsystems. Furthermore, it 
should be noted that fabric 510 is not limited fibre channel fabrics but my be extended to 
any type of switched storage network. A fabric driver 504 provides an interface between 
host system 508 and fabric 510. A persistent repository 506 is a data structure that stores 
information on the current status of the fabric devices. An administration application 502 

15 is a software program running on host system 508 and accessible to a system 
administrator. Administration application 502 provides a mechanism for discovering 
fabric devices on-demand with user input thereby eliminating the need to discover all 
fabric devices accessible to a host system at one time. As such, nodes can be created only 
for selected fabric devices (i.e., a subset of available fabric devices) during a discovery 

20 process. It should be noted that if a node is already created for a selected fabric device, it 
may not be necessary to re-create the node. 

[0035] During a discovery process, administration application 502 may query a fabric 
driver 504 for a list of devices visible to the host system 508. Fabric driver 504 provides 

25 an interface for the host system to the fabric. Fabric driver 504 may be part of the 
operating system for the host system and may include one or more modules for handling 
various functions required to interface the host system to the fabric such as protocol 
handling and transport layer operations. In one embodiment of the present invention, the 
fabric driver 504 may be a Solaris kernel module or modules. The fabric driver 504 may 

30 provide the requested list of devices to the administration application 502. A subset of 
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these devices may then be selected through administration application 502 and brought 
online by fabric driver 504 so that the subset of devices are accessible from host system 
508. Onlining the subset of devices may include the creation of a node within the 
operating system for each device wherein the node provides a reference for applications 
5 or other processes in host system 508 to reference a corresponding device in fabric 510. 
Thus, a node provides a path for an application or process running on the host system to 
communicate with one of the fabric devices. Thus, when a fabric device is onlined, a 
communication path may be established between the host system 508 and the discovered 
fabric device. 

10 

[0036] Administration application 502 thus provides a mechanism to select and 
online only a subset of the visible fabric devices. Also administration application 502 
may be run outside of the boot process so that device discovery and online operations do 
not increase the host system boot time. The administration application 502 may be run 

15 on-demand so that fabric devices may be selected and brought online on demand. For 
one embodiment of the present invention, a system administrator may use administration 
application 502 to request a list of fabric devices available through one or more host 
adapter I/O ports of host system 508. Administration application 502 may include a 
command line interface or a graphical user interface (or both) for displaying the list to the 

20 system administrator. Through this interface the system administrator may then select a 
desired subset of the listed devices and request that the selected devices be brought 
online. 

[0037] The fabric driver 504 provides APIs for the administration application 502 to 
25 make queries in order to obtain a list of devices connected to one or more host adapter 
ports. In one embodiment a transport layer of the fabric driver 504 may execute the query 
irrespective of the interconnect topology of the host adapter ports. For example, the 
fabric driver may obtain the list of devices connected to a fibre channel switched fabric by 
querying a fabric name server. The fabric name server may be located within a fabric 
30 switch or distributed across the fabric switches and maintains information about the 
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various fabric devices. The fabric name server may include a database of objects. Each 
fabric attached device may register or query useful information in the name server, 
including, name, address, class of service capability of other participants, etc. The fabric 
driver may also provide an API for obtaining a list of direct attach devices for a host. For 
5 example, the fabric driver may obtain the loop map for a host system's private loop 
topology. 

[0038] For direct attach devices, e.g. private loop topologies, operating system device 
nodes may be created during driver attach (e.g., when the fabric driver is loaded during a 
10 reboot) for all devices visible through a direct attach port. In some embodiments, 
operating system device nodes are only created for direct attach devices that support a 
particular protocol (e.g., FCP/SCSI). 

[0039] For fabric topologies connected to the host system 508, operating system 

15 device nodes may not be created until an on-demand request is made by the 
administration application 502, As discussed above, upon such a request from the 
administration application 502, the fabric driver 504 provides a list of devices visible 
through one or more fabric host adapter ports. The fabric driver 504 may obtain the list 
by accessing a fabric name server. The list of fabric devices may be provided by the 

20 administration application 502 to a system administrator, for example, through a 
graphical user interface. The system administrator may use the administration application 
502 to select and online particular devices which are desired to be used by the host system 
508. The administrator may also use administration application 502 to offline any 
devices which are no longer needed. Offlining may be removing access to a storage 

25 device form the host operating system by removing the node. The list of devices 
displayed to the administrator by the administration application 502 may include the 
information returned about the fabric devices by the fabric name server. The 
administration application 502 may request the fabric driver 504 to online or offline 
fabric devices as indicated by a system administrator using the application's user 

30 interface. In some embodiments, the administration application 502 may make requests 
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to fabric driver 504 to obtain fabric device information and/or to online/offline fabric 
devices without the involvement of a system administrator. For example, certain events 
or requests from other processes may trigger administration application 504 to online a 
fabric device(s). 

5 

[0040] The persistent repository 506 may be stored in the host system 508, or in some 
central local accessible to host system 508, indicating the current fabric devices which 
have been onlined (e.g., devices for which an operating system device node has been 
created). The information stored in the persistent repository 506 may be used so that the 
10 configuration of devices online for the host system 508 persists across reboots and 
shutdowns. For example, when the host system 508 is rebooted the persistent repository 
may be read to determine which devices were online before the reboot and the fabric 
driver may be requested to online these same devices again. 

15 [0041] The persistent repository 506 may be dynamically updated to reflect the state 
of the fabric devices. For example, if a fabric device which is currently online for the 
host system 508 is disabled on the fabric (for example, a hard drive fails or is removed 
from the fabric), fabric driver 504 may generate an event causing the persistent repository 
to be updated to reflect that the device is now offline. Similarly, if the same device later 

20 is restored on the fabric, the device may be onlined again (e.g. in response to an event) for 
the host system 508 and the persistent repository dynamically updated to reflect the 
onlined status. 

[0042] Although fabric 510 may include an extremely large number of fabric devices, 
25 the query operations made by administration application 502 to obtain a list of the fabric 
devices may be made on a per host adapter port granularity or a set of host adapter ports 
granularity so that the number of devices returned by the query may be a manageable 
number. 

30 [0043] Turning now to Figure 6, a flowchart is provided illustrating a device 
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discovery process according to one embodiment of the present invention. The discovery 
process may be part of a host system reconfiguration boot process. Alternatively, if a 
non-reconfiguration boot is performed of the host system in which device discovery is not 
performed, the discovery process may run when a previously created device node is 
5 accessed in the host system. This discovery process may also be performed if the host 
system's host adapter link is lost (e.g. cable pulled out). 

[0044] During the discovery process a fabric driver is loaded as indicated at 602. 
Note that if the fabric driver is already loaded, then it may no be necessary to load the 
10 fabric driver again. The link state of each host adapter port may be checked as indicated 
at 604 and 606. If a port's link is down, the link may be designated as offline as indicated 
at 608, and the discovery process for that link may wait for a state change in the link to 
online, as indicated at 610. If the link is later restored, the discovery process may 
continue for that link. 

15 

[0045] If the link is up, the link type is determined, as indicated at 612. In one 
embodiment, a fabric login is attempted through the link. If the fabric login is successful, 
the link is determined to be a fabric link. If unsuccessful the link is determined to be a 
direct attach link. For a direct attach link, the one or more direct attach devices are 
20 discovered and brought online by creating operating system device nodes for each direct 
attach device. If the link is a fabric link, the link is designated as such, but no device 
discovery or onlining of devices is performed for the fabric link as part of this discovery 
process, as indicated at 616. The discovery process as illustrated in Figure 6 may be 
repeated any time a link goes out (e.g., cable pulled, power off, host reboot, etc.). 

25 

[0046] The device discovery process illustrated in Figure 6 provides for the discovery 
and onlining of direct attach devices since the discovery and onlining of such devices may 
be completed quickly due to the limited number of such devices. However, for a host 
system's fabric links, device discovery is not performed as part of the normal discovery 
30 process performed at reconfiguration boot up or the first time a node is attempted to be 
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accessed after a link has been down and brought back up. Instead, fabric devices may be 
discovered using the on-demand node creation process described herein. 

[0047] One embodiment of the on-demand node creation process is illustrated by the 
5 flowchart of Figure 3. A request may be received to discover fabric attached devices, as 
indicated at 310. In response to the request to discover fabric attached devices, a fabric 
may be requested to identify fabric devices available to a host system, as indicated at 320. 
A list of identified fabric devices may be received from the fabric, as indicated at 330. 
Note that the term "list" simply refers to the information provided by the fabric driver and 
1 0 does not require any particular format. 

[0048] This list may be provided to a user for selection of a subset of the fabric 
devices, as indicated at 340. Alternatively, selection of a subset of the fabric devices may 
be performed without user involvement, as indicated at 345. A request may be received 

15 to on-line the subset of identified fabric devices, as indicated at 350. In response to the 
request to on-line the subset of identified fabric devices, a node may be created for each 
fabric device of the subset not already on-line, as indicated at 360. The node provides a 
mechanism for processes to communicate with the corresponding device from the host 
system. The on-line status on each fabric device of the subset may be stored, as indicated 

20 at 370. 

[0049] Another embodiment of the on-demand node creation process is illustrated by 
the flowchart of Figure 7. An administration application may make a request for a list of 
fabric devices, as indicated at 702. This request may have been initiated by a system 

25 administrator using the administration application for the host system. In other 
embodiments, this process may be initiated automatically, for example in response to an 
event (e.g. fibre channel protocol event) or a request from another application or process. 
A fabric driver may receive the request from the administration application as indicated at 
704. The fabric driver may access a fabric name server to obtain the requested 

30 information and return the requested list of fabric devices to the administration 
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application. Note that the term "list" simply refers to the information provided by the 
fabric driver and does not require any particular format. 

[0050] The administration application may receive the list and a subset of devices 
5 may be selected from the list, as indicated at 706. In one embodiment the list may be 
displayed through a graphical user interface to a system administrator. In other 
embodiments, a command line or textual user interface is used. The system administrator 
may select particular devices from the list to be onlined or offlined. The administration 
application may then call the fabric driver to online or offline devices as indicated by the 

10 selections made for the subset of devices from the list, as indicated at 708. The driver 
may then attempt to online the devices selected to be onlined (and may offline the devices 
selected to be offlined), as indicated at 710. Onlining a device may include the creation 
of an operating system device node for that device. The device node provides a 
mechanism for processes to communicate with the corresponding device from the host 

15 system. 

[0051] A persistent repository may be updated (or created if not already existing) to 
indicate which devices are currently online, as indicated at 712. During operation, the 
persistent repository may be updated to reflect any changes in fabric devices. For 
20 example, if a device indicated by the persistent repository to be currently onlined is 
removed from the fabric the persistent repository may be updated accordingly as indicated 
at 714. Changes in the fabric may be detected by an event generated in the fabric and 
communicated to the administration application (or library) by the fabric driver. 

25 [0052] Figure 8 illustrates a host system 800 coupled to a fabric 510 according to one 
embodiment of the present invention. The host system 800 includes a fabric driver 504 
for communicating with a fibre channel fabric. A library 503 may be provided as an 
interface between the administration application 502 and the fabric driver 504. The 
library may be made part of the operating system libraries and may be useable by other 

30 applications on the host system. For one embodiment of the present invention, fabric 
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driver 504 may include various sub-modules. For example, in a fibre channel 
implementation, the fabric driver may include a fibre channel protocol driver module 
(FCP) 802. The FCP module may be part of the operating system kernel and may 
perform all protocol related operations required for fibre channel use on the host 
5 operating system. For example, FCP module 802 may be a SCSI over fibre channel 
encapsulation driver module for supporting SCSI over fibre channel. Driver 504 may 
also include a transport layer 804. This module may perform all generic fabric 
operations. In one embodiment transport layer 804 may include a fibre channel port (FP) 
driver for each fibre channel port on the host system. Each FP driver may also be part of 

10 the operating system kernel. The FP driver performs all generic fibre channel operations 
such as topology discovery (e.g., loop, point-to-point, fabric, etc.), device discovery (on 
various topologies), handling extended link services, handling link state changes, etc. 
The fabric driver 504 may also include host adapter drivers 808 for each host 
adapter/controller board on the host system. For example FCA drivers may be present for 

15 fibre channel adapters having fibre channel ports on the host system. 

[0053] Figure 9 illustrates a more detailed flowchart of the on-demand node creation 
process for fibre channel host adapter ports of a host system. In one embodiment, the 
host system may be executing a UNIX type operating system such as the Solaris™ 
20 operating system from Sun Microsystems. A Solaris operating system and fibre channel 
fabric will be assumed by way of example in the following description. 

[0054] A user (e.g. system administrator, other process, etc.) may launch or access the 
administration application to obtain a list of devices available on a fabric port (e.g. FCA 

25 port), as indicated at 902. For example, a system administrator may interface to the 
administration through a graphical user interface (GUI), command line use interface, etc. 
Through the user interface, the system administrator may query for devices available on a 
single port or on a set of ports, as indicated at 904. On Solaris, for example, an FCA port 
may have a file system representation of the form, e.g., 

30 /devices/pci@lf,0/pci@l/SUNW,qlc@4/fp@0,0:fc. 
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[0055] One or more library interfaces may be provided as an interface between the 
administration application and the fabric driver. This library interface(s) may be made 
part of the operating system's standard storage libraries. The administration application 
5 may then call one or more of the library interfaces to obtain the list of devices, as 
indicated at 906. These libraries may be shared between the administration application 
and other storage applications. The library calls into the fabric driver to obtain the list of 
devices, as indicated at 908. 

10 [0056] In one embodiment, the library calls into an FCP module using the standard 
driver IOCTL interface (the call may actually be made into an FP module which merely 
passes on the IOCTL call to the FCP module) to obtain the list of devices. The library 
may then wait for the FCP module to return the list. The FCP module may then make a 
call into a port driver module(s) to obtain the list of fabric devices available through the 

15 fabric port(s) on which the request was made, as indicated at 910. For example, the FCP 
module may call an FP module(s) using the FC transport APIs between ULPs and the FC 
transport to obtain the list of fabric devices available through the FCA port(s) on which 
the request was made. 

20 [0057] The fabric driver (e.g. port driver module(s) of the fabric driver) then obtains 
the device information from the fabric. In one embodiment, the FP module(s) may query 
a NameServer on the fabric (the Name Server may be maintained by FC switches) to 
obtain the list of FC ports and return this list to FCP, as indicated at 912. 

25 [0058] In one embodiment, the fabric driver may check the list for devices following 
a particular protocol and return a list of those devices to the administration application 
library interface. For example, the FCP module may check for SCSI ports from the 
received list (e.g. disks and tapes) and return the list of SCSI capable FC ports to the 
library, as indicated at 914. In another embodiment, the list may include selective LUNs 

30 (logical units) behind an FC port. The library may then pass this list on to the 
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administration application, as indicated at 916. The administration application may then 
display the list through its user interface, as indicated at 918. 

[0059] Turning now to Fig. 10, a flow chart is provided illustrating a method for 
5 onlining selected fabric devices on-demand from a list of fabric devices, according to one 
embodiment. In one embodiment, a list of fabric devices may have been obtained by the 
method illustrated in Fig. 9. A user (e.g. system administrator, other process, etc.) 
chooses a subset of devices from this list to online and passes this list of devices to the 
administration application, as indicated at 932. The administration application may then 

10 call the fabric driver to online the selected devices. For example, the administration 
application may call an FCP module (via a library interface) to online the selected 
devices, as indicated at 934. The FCP module, using the services of FP module(s), 
attempts to online each of the selected devices in the list and reports each successful 
online to the library, as indicated at 936. For every device successfully onlined by the 

15 FCP module, the administration application library interface updates a persistent 
repository to reflect devices currently onlined, as indicated at 938. Note also that 
offlining a node through the administration application may cause an event to be 
generated to trigger an update the persistent repository. 

20 [0060] Turning now to Fig. 11, one embodiment is illustrated of a mechanism for 
dynamically updating the persistent repository to reflect changes that occur in the fabric. 
A device state change may occur in the fabric, as indicated at 950. For example, a fabric 
disk drive online for the host system may be removed from the fabric. An event may be 
generated to indicate this change. The FCP module may inform the library/application of 

25 such changes that effect the device list, as indicated at 952. The administration 
application library interface may update the contents of the persistent repository in 
response to receiving notification of a change, as indicated at 954, so that the persistent 
repository is dynamically updated to reflect such changes. The persistent repository may 
be stored, for example, on persistent storage such as a disk drive or non-volatile memory. 

30 
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[0061] The persistent repository may allow a host's fabric device configuration to 
persist across reboots and shutdowns, as illustrated in Fig. 12 for one embodiment. On a 
host reboot (970), a component of administration application (e.g. in the Solaris 're' 
scripts) reads the persistent repository to determine which devices were previously online, 
5 as indicated at 972. The administration application then calls the fabric driver (via the 
library) to online the fabric devices that were onlined prior to the reboot, as indicated at 
974. The fabric driver attempts to online each device indicated by the persistent 
repository and reports successful onlines to the library, as indicated at 976. The library 
may then update the persistent repository to reflect the currently online devices, as 
10 indicated at 978. 

[0062] An example of an entry in a persistent repository is: 
/devices/pci@lf,4000/pci@2/SUNW 5 qlc@4/fp@0,0:fc::50020f2 

In this example, the entry identifies the /devices path to an onlined FC port. In other 
15 embodiments, additional information may be included. For example, the repository may 
identify onlined fabric devices on a per LUN basis. 

[0063] As discussed above, fabric devices may be efficiently configured for access 
through a host adapter port on a host computer by using an on-demand node creation 

20 process. Also, a persistent repository may store an indication of fabric devices that are 
online through each host adapter port. The persistent repository may be used to maintain 
the node configurations for each host adapter port across reboots and shutdowns. Thus, 
fabric devices may initially be configured, for example, through an administration 
application which initiates node configuration requests for selected fabric devices. If the 

25 host system is rebooted, the previous fabric device node configurations may be restored 
by accessing the persistent repository to determine the previously onlined fabric devices 
and bringing those devices online again. 

[0064] In some embodiments, various users or applications on a host system may 
30 desire different configurations of fabric devices to be used from the host system. Some 
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applications or processes running on a host system may only need to access certain fabric 
devices for a specific amount of time or at certain times. During other times the same 
fabric devices may not need to be accessed by the application or process. In some 
embodiments, an application may need to configure certain fabric devices for exclusive 
5 access for a particular period of time and may then no longer require access or may allow 
shared access to the fabric device(s). 

[0065] One example of an application that may require access to fabric devices for 
only a limited amount of time is a storage backup process. At certain time periods a 

10 storage backup process may be executed to backup the data stored on one or more fabric 
storage devices. For example, a backup process may be scheduled to run daily at 2 a.m. 
The storage backup process may run on the same or a different host system than a file 
server process which has configured the fabric storage devices for storage access. When 
the storage backup process is ready to begin a backup procedure, it may need to configure 

15 both the fabric storage devices that are to be backed up and one or more fabric backup 
storage devices, such as a tape or optical storage device. Once the storage backup process 
has completed the backup operation it may no longer need access to these fabric devices 
until time for the next backup operation. 

20 [0066] Thus, it may be desirable to have an interface which allows different users or 
different applications on a host system to create different fabric device configurations for 
use from the host system. A standard interface may be provided for creating and 
maintaining various different fabric device configurations for a host system. The 
standard interface may allow for the creation of user specific or application specific fabric 

25 device configurations. 

[0067] Turning now to Figure 13 a standard fabric configuration interface 560 may be 
provided for creating and maintaining various different fabric device configurations on a 
host system 1300. The host system 1300 may have one or more ports 1302 for coupling 
30 to a fabric. The fabric configuration interface 560 may provide an interface through 
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which an application may request a list of fabric devices accessible to host system 1300 
or accessible on a particular port 1302. In response to a request for a list of fabric 
devices, the interface may query fabric driver 504 which may obtain the list from a name 
server for fabric 104. The fabric configuration interface 560 provides the fabric device 
5 list to the requesting application. The fabric configuration interface may support various 
user interfaces such as a command line or graphical user interface for requesting and 
viewing the fabric device list. The fabric configuration interface 560 may provide an 
interface for an application to specify an existing fabric device configuration to be 
modified. For example, fabric configuration interface 560 may store a representation of 
10 each different fabric device configuration as a configuration repository 562. Thus, 
multiple different configuration repositories (e.g. 562a-n) may exist, each one 
representing a different fabric device configuration. The fabric configuration interface 
560 may allow an application to create and modify different configuration repositories 
562. 

15 

[0068] Fabric configuration interface 560 provides an interface for an application to 
select or deselect fabric devices for host configuration. As described above, host 
configuration may include the creation of an operating system node representing a 
particular fabric device and which provides a mechanism for an application to 
20 communicate with that particular fabric device. The fabric configuration interface 560 
may store information indicating the fabric device configuration as selected by an 
application into a configuration repository 562. Multiple different versions of a 
configuration repository 562 may be created and maintained through this process. 

25 [0069] Fabric configuration interface 560 also provides an interface for verifying 
particular configurations as indicated by a configuration repository 562. The verification 
operation may include requests through fabric driver 504 to verify that selected fabric 
devices are still available on fabric 104. Fabric configuration interface 560 may perform 
this verification operation before requesting configuration of (e.g. node creation for) 

30 fabric devices selected from an existing configuration repository 562. 
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[0070] The fabric configuration interface 560 may be part of library 503 as described 
with Fig. 8, The fabric configuration interface 560 provides an interface through which a 
particular fabric device configuration may be applied based on the need of a particular 
5 application or host operation. For example, an application may need certain fabric 
devices to be configured in order to perform a particular task. Thus, fabric configuration 
interface 560 provides a mechanism for a user or application on a host system to create 
multiple different fabric device configurations. Each different fabric device configuration 
may be represented in a different configuration repository 562. In one embodiment, the 

10 configuration repositories 562 may be stored in the non- volatile memory, such as on a 
disk drive. In another embodiment, the configuration repositories 562 may be stored in 
other memory such as the host's system memory (e.g. volatile RAM). In one 
embodiment, one of the configuration repositories 562 may be a default configuration 
repository which may indicate the initial fabric device configuration for the host upon 

15 reboot. 

[0071] For one embodiment of the present invention, fabric driver 504 may include 
various sub-modules as illustrated in Fig. 13 A. For example, in a fibre channel 
implementation, the fabric driver may include a fibre channel protocol driver module 

20 (FCP) 802. The FCP module may be part of the operating system kernel and may 
perform all protocol related operations required for fibre channel use on the host 
operating system. For example, FCP module 802 may be a SCSI over fibre channel 
encapsulation driver module for supporting SCSI over fibre channel. Driver 504 may 
also include a transport layer 804. This module may perform all generic fabric 

25 operations. In one embodiment transport layer 804 may include a fibre channel port (FP) 
driver for each fibre channel port on the host system. Each FP driver may also be part of 
the operating system kernel. The FP driver performs all generic fibre channel operations 
such as topology discovery (e.g., loop, point-to-point, fabric, etc.), device discovery (on 
various topologies), handling extended link services, handling link state changes, etc. 

30 The fabric driver 504 may also include host adapter drivers 808 for each host 
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adapter/controller board on the host system. For example FCA drivers may be present for 
fibre channel adapters having fibre channel ports on the host system, 

[0072] Turning now to Fig. 14, a persistent repository 506 such as described above 
5 with Figs. 5 and 8, may be stored in addition to various configuration repositories 562. 
The persistent repository may indicate a main, or default, configuration for the host 
system. The configuration indicated by the persistent repository 506 may be the 
configuration that is restored upon a reboot. For example s upon a configuration reboot, 
the persistent repository 506 may be read and the fabric devices indicated to be 

10 configured by the default configuration repository may be verified and then configured 
(e.g. node created for each device). Fabric configuration interface 560 may also be used 
to create or modify specific configuration repositories 562 for specific purposes. It may 
be inefficient for a user or application to open, search, and modify a single large global 
configuration repository to create specific fabric device configuration. Having an 

15 interface to modify or create different configuration repositories may provide a more 
efficient fabric device configuration mechanism for many applications. 

[0073] Turning now to Figure 15 a flowchart is provided illustrating a method 
according to one embodiment in which an application may use the fabric configuration 

20 interface 560 to modify or create a specific fabric device configuration. For example, an 
application may need certain fabric devices to be configured in order to perform a 
particular task. Figure 15 illustrates a flowchart of a fabric device management process, 
according to one embodiment. An application may desire to manage or utilize a subset of 
the attached devices on the fabric. The process described below may provide a method 

25 whereby the application may select and utilize such a subset of devices from a list of 
available devices on the fabric. 

[0074] As Figure 15 shows, in 1500, the application may query the fabric 
configuration interface for available devices on the fabric. The available devices on the 
30 fabric may include both configured and un-configured devices which are attached to the 



Atty Dkt No 5181-68400/P4989 



24 



Conley Rose & Tayon, P C 



fabric. In one embodiment, the application may query the fabric interface for available 
devices on a particular port. In another embodiment, the application may query the fabric 
interface for all available devices of a particular type, such as all available hard drives. 
As indicated in 1502, the fabric configuration interface may communicate with a fabric 
5 driver to request a list of the available devices to the application. The fabric device driver 
may query the fabric (e.g. fabric name server) to generate the list of available devices and 
return the list to the fabric configuration interface. 

[0075] In 1504, the application may select a subset of the available devices from the 
10 list. Such a subset may be desired because the application may only have need for the 
services of a small number of devices. Configuration information may be indicated for 
each available device. The configuration information for a device may include one or 
more of a device name, the current configuration status of the device, or any other device- 
related information which may be useful to the application. In one embodiment, the 
15 device name may include a particular port designation associated with the device, 
concatenated with a world-wide name for the device, as used by the fabric to denote the 
device. The fabric configuration interface may also provide for the application to set a 
desired configuration status for the device. The application may set a field in the 
configuration information for each selected device to indicate the desired configuration 
20 status for that device. Then, in response to the application's selection, the fabric interface 
may request node creation for the selected devices and may record the configuration 
information for each of the selected devices in a configuration repository. 

[0076] In one embodiment, the application may instruct the fabric configuration 
25 interface to create a new configuration repository, as indicated in 1506A. Alternatively, 
the fabric interface may update or modify an existing configuration repository, as 
indicated in 1506B. For example, an application may select one or more fabric devices 
from the list of available fabric devices to be added to an existing configuration 
repository's list of devices to be configured. Thus, a configuration repository may specify 
30 a subset of available fabric devices. The application may thus access configuration 
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information for each of the devices in the subset of devices which was selected by the 
application. Note that in one embodiment, the configuration repository may be associated 
with a particular application, in that the subset of devices in that repository has been 
selected by that application. For example, in the case mentioned above wherein the 
5 application is a backup utility program, the application may be responsible for 
periodically copying data from the host computer system to one or more particular tape 
drives or optical drives. The application may therefore create a configuration repository 
for only on those devices which are involved in the backup process. 

10 [0077] The fabric configuration interface may configure each device whose desired 
configuration status indicates that the device should be configured, as indicated at 1510. 
The fabric configuration interface may allow a the desired configuration status to be 
specified by a user or application. In some embodiments, the desired configuration status 
may also be stored in the configuration repository. In one embodiment, the fabric 

15 configuration interface may pass the newly created or modified configuration repository 
to a fabric driver. The fabric driver may initiate or perform the node creation process for 
the fabric devices whose configuration status indicates that configuration is desired. If 
the configuration repository is a modified or updated existing configuration repository, 
entries for some of the fabric devices marked for configuration may have been created 

20 prior to the current configuration process. Thus, the fabric configuration interface may 
request that the fabric devices indicated to be configured are first verified to ensure they 
are still available on the fabric, as indicated at 1508. A verification request may be made 
to the fabric driver which may verify each device to be configured with the fabric name 
server. If the configuration repository is newly created from a fabric device list just 

25 obtained from the fabric, verification may not be needed. The fabric configuration 
interface may then request that each fabric device marked for configuration be 
configured, as indicated at 1510. As mentioned above, a device may be configured by the 
host creating a network node corresponding to the device, wherein the node functions as 
an internal representation of the device on the host's network. 

30 
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[0078] Note that the flow charts described herein do not necessary require a temporal 
order. For example, the fabric interface may record configuration information (1506) 
before, after or during verification of availability of devices (1508). As a further 
example, configuration of devices (1510) may be performed before the configuration files 
is updated or stored (1506). 

[0079] Figure 15 illustrates an embodiment in which an application or user requests 
the fabric configuration interface to provide a list of currently available fabric devices. 
The list is obtained from the fabric driver and fabric name server. Thus, the embodiment 
described for Figure 15 uses this fabric device list as the source of information from 
which to select devices for configuration. Additionally or alternatively, an application or 
user may use information from an existing configuration repository as the source of 
information from which to select devices for configuration (or unconfiguration). Figure 
16 is a flowchart of such an aspect of the fabric device management process, according to 
one embodiment. As Figure 16 shows, in 1512 the application may indicate a particular 
configuration repository to the fabric interface. The application or user may desire to 
alter or add to the configuration indicated by the configuration repository, or the 
application may want to verify the indicated configuration. In this way the application 
may utilize the same configuration file from session to session without danger of trying to 
access a device that is no longer configured or accessible on the fabric. 

[0080] In one embodiment, the fabric interface may provide the contents of the 
configuration repository to an application, as indicated in 1514. In some embodiments, 
the configuration repository may be displayed to a user. In 1516 the application (or a user 
through an application) may modify the configuration information in the configuration 
repository, for example, by changing adding or deleting entries. Also, the application (or 
a user through an application) may specify the desired configuration status for each 
selected device. 

[0081] In response to a verification request from the application, in 1518 the fabric 
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configuration interface may verify the availability of each selected device, by querying the 
fabric device driver regarding the availability and/or actual configuration status of each 
device. In the event that a device is determined to be unavailable, i.e., there is a 
verification error, the application may cancel the process and may execute the process 
described with reference to Figure 15 to add new devices to the configuration file, if 
necessary. Alternately, in the event of a verification error the application (or user) may 
determine that the available resources are sufficient and continue the process. 

[0082] Finally, in 1520, in response to a configuration request from the application, 
the fabric configuration interface may request configuration (via the fabric driver) of each 
device whose availability has been verified and whose desired configuration status 
indicates that the device is to be configured. 

[0083] In one embodiment, the application may request that the fabric interface un- 
configure at least one device. In response to the un-configure request, the fabric 
configuration interface may request the fabric device driver to un-configure the device 
and report the results to the application. 

[0084] In another embodiment, the application may be operable to de-select a device 
from the configuration file, in which case the configuration information of the de-selected 
device may be removed from the configuration file by the fabric interface. In one 
embodiment, no configuration action is taken for devices not listed in the submitted 
configuration repository. 

[0085] One example of a format in which device configuration information may be 
presented to an application or user by the fabric configuration interface is as follows. In 
various embodiments, some or all of this information may be stored in a configuration 
repository. 

[0086] Fabric FCA port : /dev/fc/fp0 
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Port WWN Device Type 

22000020370498af disk device 

22000020370499el disk device 

50800200000000b3 enclosure device 

22000020370497a7 disk device 

2200002037049e60 disk device 



Capacity Configure Comments 
9G y PGR Read Only 

18G 

9G y 
18G 



Fabric FCA port : /dev/fc/fpl 



22000020370498ff disk device 

22000020370499dl disk device 

22800200000000a3 disk device 

2200002037049797 disk device 



9G 
18G 
18G 
9G 



PGR Read Only 



[0087] The Configuration field may be modifiable by the user or application and 
10 indicates whether the device is to be configured or not. As discussed above, depending 
on the user's or application's needs, the source of the device list may be a current fabric 
device list obtained from a fabric driver or may be from an existing configuration 
repository. The user or application may specify the source of the device list. For a 
current fabric device list, the fabric configuration interface may query one or more fabric 
15 host ports and get the list from the fabric name server. For example, a user or application 
may chose this source to get an initial list of fabric devices or a current list in order to 
create a new or modify an existing configuration. 

[0088] A user or application may specify a previously saved configuration repository 
20 as the source in order to update, modify, and/or verify that existing configuration. As 
discussed above, if a configuration is updated or modified from a previously generated 
configuration repository, the fabric configuration interface may provide for verifying the 
updated or modified configuration repository before attempting to configure or 
unconfigure the fabric devices. The accessibility on the fabric of each device with the 
25 Configuration field set may be checked. Also, devices indicated to be unconfigured (e.g. 
Configure field not set) may be checked to determine if they are currently configured for 
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use by another application or process, such as a device mounted for a file system process. 
A warning may be generated if a device marked to be unconfigured is configured for use 
by another process or application. In general, detailed information from the result of this 
verification process may be reported back to the user or application. 

5 

[0089] Once a submitted configuration repository is verified (or if no verification is 
desired), the devices may be configured as indicated. A node creation operation may be 
performed for each device with the Configure field set and a node deletion operation for 
each device with the Configure field not set. The node creation/deletion operation may 
10 be combined with the verification operation to reduce the chance of any intervening 
fabric state changes. 

[0090] An application may need to work with more than one subset of devices on the 
fabric, in which case the fabric configuration interface may provide for maintaining 
15 additional configuration repositories such that each additional configuration repository 
corresponds to a different subset of devices used by the application. The fabric 
configuration interface may provide for configuring different sets of fabric devices for 
one or more different applications while a host is up and running. 

20 [0091] The fabric configuration interface may create additional configuration 
repositories to store configuration information related to selected subsets of available 
devices on the fabric for additional applications residing on the host computer system. 
For example, each additional application may have one or more configuration repositories 
to store configuration information of a corresponding one or more subsets of fabric 

25 devices. The configuration repositories for each additional application may be created 
and managed according to the processes described above with reference to Figures 15 and 
16. Specifically, each of the additional applications may specify an existing configuration 
repository and/or query the fabric configuration interface for available devices on the 
fabric, the fabric interface may communicate with the fabric device driver to provide a list 

30 of available devices to each additional application in response to said querying, each of 
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the additional applications may select respective subsets of the available devices and 
indicate a desired configuration status and name for each device, and the fabric interface 
may record the configuration information for each of the devices in the respective subsets 
of available devices in one or more additional configuration repositories. Each additional 
5 configuration repository may thus correspond to one of the respective subsets, and each 
additional configuration repository may correspond to one of the additional applications. 
In various embodiments, each configuration file may be stored in a location specified by 
the corresponding application, or in a central storage on the host computer. 

10 [0092] Various modifications and changes may be made as would be obvious to a 
person skilled in the art having the benefit of this disclosure. Note also that the flow 
charts described herein do not necessary require a temporal order. It is intended that the 
following claims be interpreted to embrace all such modifications and changes and, 
accordingly, the specifications and drawings are to be regarded in an illustrative rather 

15 than a restrictive sense. 

[0093] Various embodiments may further include receiving, sending or storing 
instructions and/or data implemented in accordance with the foregoing description upon a 
computer readable medium. Generally speaking, a computer readable medium may 
20 include storage media or memory media such as magnetic or optical media, e.g., disk or 
CD-ROM, volatile or non-volatile media such as RAM (e.g. SDRAM, DDR SDRAM, 
RDRAM, SRAM, etc.), ROM, etc. as well as transmission media or signals such as 
electrical, electromagnetic, or digital signals, conveyed via a communication medium 
such as network and/or a wireless link. 

25 
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